IN THE CLAIMS 



1 . (currently amended) A system for automatically decomposing an 
image sequence, comprising a computer-readable storage medium storing a 
program that when executed causes: 

a computer to perform the following process actions, 
providing an image sequence of at least one image frame of a scene; 
providing only a preferred number of classes of objects to be identified within 
the image sequence; 

automatically decomposing the image sequence into the preferred number of 
classes of objects, using probabilistic inference and learning to compute a single 
set of model parameters comprising a mean visual appearance and variance of 
each class in the image sequence, processing the provided image sequence and 
computing the single set of model parameters at a [[same rate]] substantially 
same time that the image sequence is provided, wherein automatically 
decomposing the imaae sequence into the preferred numb er of object classes 
comprises performing a probabilistic variational expecta tion-maximization 
analysis, comprising: 

forming a probabilistic model having variatio nal parameters representing 
posterior distributions; 

initializing said probabilistic model; 
inputting an imaoe frame from the image sequence; 
computing a posterior given observed data in said im age sequence; and 
using the posterior of the observed data to up date the probabilistic model 
parameters. 



2. (original) The system of Claim 1 wherein providing the preferred 
number of objects comprises specifying the preferred number of classes of 
objects via a user interface. 
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3. (original) The system of Claim 1 wherein decomposing the image 
sequence into the preferred number of objects comprises automatically learning 
a 2-dimensional model of each object class. 

4. (original) The system of Claim 3 wherein the model employs a 
latent image and a translation variable in learning each object class. 

5. (original) The system of Claim 1 wherein automatically 
decomposing the image sequence into the preferred number of object classes 
comprises performing an inferential probabilistic analysis of each image frame for 
identifying the preferred number of object class appearances within the image 
sequence. 

6. (original) The system of Claim 5 wherein performing an inferential 
probabilistic analysis of each image frame comprises performing a variational 
generalized expectation-maximization analysis of each image frame of the image 
sequence, wherein the expectation-maximization analysis employs a Viterbi 
algorithm in a process of filling in values of hidden variables in a model 
describing the object class. 

7. (original) The system of Claim 6 wherein the model describing the 
object class employs a latent image and a translation variable in filling in said 
hidden variables. 

8. (original) The system of Claim 6 wherein an expectation step of the 
generalized expectation-maximization analysis maximizes a lower bound on a 
log-likelihood of an image frame by inferring variational approximations of 
variational parameters. 

9. (original) The system of Claim 8 wherein a maximization step of 
the generalized expectation-maximization analysis automatically adjusts object 
model parameters in order to maximize the lower bound on the log-likelihood of 
the image frame. 
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1 0. (original) The system of Claim 9 wherein the expectation step and 
the maximization step are performed once for each image in said image 
sequence. 

11. (original) The system of Claim 8 wherein automatic computation < 
the expectation step is accelerated by using an FFT-based inference analysis. 

12. (original) The system of Claim 1 1 wherein the FFT-based 
inference analysis is performed on variables that are converted into a coordinal 
system wherein transforms applied to those variables are represented by shift 
operations. 

1 3. (original) The system of Claim 8 wherein automatic computation 
the expectation step is accelerated by using a Viterbi analysis. 



14. (canceled) 

15. (canceled) 

16. (currently amended)The system of Claim [[1 5]] 1 wherein the 
variational expectation-maximization analysis further comprises: 

outputting the model parameters. 

1 7. (original) The system of Claim 1 5 further comprising incrementing 
to the next image frame in said image sequence and repeating the actions after 
initializing the probability model until the end of the image sequence has been 
reached. 



1 8. (original) The system of Claim 1 further comprising a generative 
model which includes a set of model parameters that represent the entire image 
sequence. 
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19. (original) The system of Claim 1 further comprising a generative 
model which includes a set of model parameters that represent the images of the 
image sequence processed to that point. 

20. (original) The system of Claim 1 9 wherein the model parameters 
include: 

a prior probability of at least one object class; and 
means and variances of object appearance maps. 

21 (original) The system of Claim 20 wherein the model further 
comprises observation noise variances. 

22. (original) The system of Claim 1 9 further comprising automatically 
reconstructing a representation of the image sequence from the generative model, 
wherein the representation comprises the preferred number of object classes. 

23. (currently amended) A computer-implemented process for 
automatically generating a representation of an object in at least one image 
sequence, comprising a computer-readable storage medium storing a program: 

that when executed causes a computer to, 

acquire at least one image sequence, each image sequence having at least 
one image frame; 

automatically decompose each image sequence into a generative model with 
each generative model comprising a set of model parameters comprising a mean 
visual appearance and variance of each class in the image sequence being 
decomposed, using an expectation-maximization analysis that employs a Viterbi 
analysis, wherein each generative model is computed at a [[same rate]] substantially 
same time that the at least one image sequence is acquired, wherein an expectation 
step of the generalized expectation-maximization an alysis maximizes a lower bound 
on a loa-likelihood of each imaoe frame b v inferring approximations of variational 
parameters . 



5 



24. (original) The computer-implemented process of Claim 23 wherein 
the number of object classes learned for each image sequence is input via a user 
interface. 

25. (original) The computer-implemented process of Claim 23 wherein 
the model parameters of each generative model include an object class appearance 
map, and a prior probability of at least one object class. 

26. (original) The computer-implemented process of Claim 25 wherein 
the object class appearance map for each generative model includes means and 
variances of that object class appearance map. 

27. (original) The computer-implemented process of Claim 23 wherein 
a latent image and a translation variable are employed in determining said 
generative model. 

28. (canceled) 

29. (original) The computer-implemented process of Claim 23 wherein 
the maximization step of the generalized expectation-maximization analysis 
automatically adjusts model parameters in order to maximize a lower bound on a 
log-likelihood of each image frame. 

30. (original) The computer-implemented process of Claim 23 wherein 
the expectation-maximization analysis comprises: 

forming a probabilistic model having variational parameters representing 
posterior distributions; 

initializing said probabilistic model; 

inputting an image frame from the image sequence; 

computing a posterior given observed data in said image sequence; and 

using the posterior of the observed data to update the probabilistic model 
parameters. 
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31 . (original) The computer-implemented process of Claim 30 wherein 
the expectation-maximization analysis further comprises: 

outputting the model parameters. 

32. (original) The computer-implemented process of Claim 23 wherein 
computation of the expectation step is accelerated using an FFT-based inference 
analysis. 

Claims 33-38 (canceled). 
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